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REMARKS 

Claims 20 and 22 have been deleted and claims 33 and 34 added by this amendment. 
Claims 16,17 and 24-29 have been withdrawn. Therefore, on entering this amendment, claims 
14, 15, 18, 19, 21, 23, 30-34 are all the claims pending in the application. 

Formal drawings are being submitted herewith with the changes approved by the 
Examiner. 

The Examiner continues to object to the specification. The Applicant respectfully 
submits that subsections and the order of presenting them are not held to be absolute 
requirements under current US patent laws and practice. However, for a speedier resolution of 
the issue, the Applicants submit a substitute specification. Also attached is a marked-up copy 
indicating changes from the original specification filed on October 15, 1999. 

Claims 14, 17, 23, 30 and 31 have been objected to. The AppUcants respectfully amend 
these claims to overcome the objection. 

Claims 14, 18, 20, 21 and 30-32 have been rejected as being anticipated by Ogawa 
(5,694,203). 

Claims 15, 19, 22 and 23 have been rejected as anticipated by Stem (5,216,259). 

The Applicants traverse the rejections and request reconsideration. 

The Applicants thank the Examiner for the detailed technical comparison between the 
cited references and the present invention. In the outstanding Office Action, the Examiner 
provides some suggestions for amending claims. Specifically the Examiner suggests adding 
limitations, including "illuminating an object sequentially with two illuminating lights, one of 
which has a linearly varying intensity and the other of which has a constant intensity" (or its 
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equivalents). In a telephone conversation with the Applicants' representative, the Examiner 
clarified that the above limitations and their equivalents are free of prior art. 

The Applicants amend claims 14 and 15 to include the above limitation. Accordingly, 
claims 20 and 22 have been deleted. Claim 30 has been amended as appropriate to include 
similar limitations. New claims 33 and 34 have been added to include the equivalent limitation 
that one of the illuminating Ughts has a linearly increasing intensity and the other has a linearly 
decreasing intensity. Claims 21 and 23 now depend from the newly added claims 33 and 34. 

With the above changes, it is believed that all the pending claims are not anticipated (or 
suggested by Ogawa or Stein. 
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CONCLUSION 

In view of the above, reconsideration and allowance of this application are now believed 
to be in order, and such actions are hereby solicited. If any points remain in issue which the 
Examiner feels may be best resolved through a personal or telephone interview, the Examiner is 
kindly requested to contact the undersigned at the telephone number listed below. 

The USPTO is directed and authorized to charge all required fees, except for the Issue 
Fee and the Pubhcation Fee, to Deposit Account No. 19-4880. Please also credit any 
overpayments to said Deposit Account. 



Respectfully submitted. 




SUGHRUE MION, PLLC 
Telephone: (202) 293-7060 
Facsimile: (202) 293-7860 



Chid S. Iyer 
Registration No. 43,355 
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Date: December 10, 2003 
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[DOCUMENT N7VME] OrECIFICATION 

[TITLE OF THE II^JVENTIOM] 



METHOD AND DEVICE FOR DETECTING THREE-DIMENSIONAL 

INFORMATION 

[WHAT IS CLAIMED IC : ] 

[Claim 1] A method of detecting three dimcnoional 
information, — compriaing atcpo of : 

forming an image of an object illuminated by- 
illumination light having given intenoity aa an 
optical — image ; — and 

detecting a diotance between individual pointo of 
the object on the baaio of an image obtained by 
acquioition of the optical image with a given image 
piclc up gain, — wherein either the given intenaity or 
the image piclc up gain io changed with time, — and the 
diotance between reapective pointa of the object can 
be detected at a opced at which three dimcnaional 
information can be followed real time within a period 
of time correoponding to the frame of a video oignal. 

[Claim 2] — The method of detecting three 
dimcnoional information aa defined in claim 1, — wherein 
firot and oecond optical imageo of the object 



illuminated by firot and accond illumination light, 
cither of which includca time varying intcnaity, — aaee 
formed; — firat and occond imagco are obtained by 
acquiring the firot and aecond optical imagco with a 
ainglc image pick up gain over a given period of time; 
and the diotance between reapective pointo of the 
object can be detected on the baoio of the firot and 
oecond imagco at a opced at which the three 
dimcnoional information can be followed real time 
within a period of time corrcoponding to the frame of 
a video oignal . 

[Claim 3] — The method of detecting three 
dimcnoional information ao defined in claim 2, — wherein 
the intcnoity of the firot illumination light io 
incrcaocd or dccroaocd with time, — and the occond 
illumination light hao a given intcnoity. 

[Claim 4] — The method of detecting three 
dimcnoional information ao defined in claim 2, — wherein 
the intcnoity of the firot illumination light io 
incrcaocd with time, — and the occond illumination light 
io decrcaoed with time. 

[Claim 5] — The method of detecting three 
dimcnoional information ao defined in claim 1, — wherein 
there arc formed firot and oecond optical imagco of 
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the object illuminated by firot and occond 
illumination light which illuminate with oinglo 
intenoity over a predetermined period of time; — and the 
diotance between reopective points of the object io 
detected from the firot and aecond imageo which are 
produced by acquioition of the firat and oecond 
optical imageo with the firot and occond image piclc up 
gaina , — either of which io changed with time, — at a 
apeed at which the three dimenoional information can 
be followed real time within a period of time 
correaponding to the frame of a video oignal . 

[Claim 6 ] — The method of detecting three 
dimenoional information ao defined in claim 5, — wherein 
the firot image piclc up gain io incrcaocd or decreaoed 
with time, — and the oecond image pick up gain io 
uniform. 

[Claim 7] — The method of detecting three 
dimenoional information ao defined in claim 5, — wherein 
the firot image piclc up gain io incrcaocd with time, 
and the oecond image pick up gain io decreaoed with 
time , 

[Claim 8 ] — The method of detecting throe 
dimenoional information ao defined in any one of 
claimo 1 through 7, — wherein the image io acquired a 
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plurality of timco within a period of time 
corrcoponding to the frame of a video oignal. 

[Claim 9] — A device for detecting three 
dimcnoional information pertaining to an object 
comprioing ; 

a projection ocction capable of projecting 
illumination light having given intcnoity on the 
object ; 

an image pick up ocction capable of acquiring an 
image of the object with a given image pick up gain; 
and 

a aignal proccoaing ocction which calculateo the 
diatance between reopective pointo of the object on 
the baoio of intencity level information included in a 
video aignal output from the image pick up ocction, 
wherein either the given intenaity or the image pick 
up gain io changed with time, — and the diotance between 
rcapectivc pointa of the object can be detected at a 
apecd at which the three dimenaional information can 
be followed real time within a period of time 
corrcoponding to the frame of a video oignal . 

[Claim 10] — The device for detecting three 
dimenaional information aa defined in claim 9, — wherein 
the projection acction ia equipped with a light 
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emitting clement whooo light can be modulated in 
accordance with an electric oignal . 

[Claim 11] — The device for detecting three 
dimenoional information ao defined in claim D, wherein 
the projection oection comprioco a light emitting 
element, and a modulator capable of modulating light 
emitted from the light emitting element. 

[Claim 12] — The device for detecting three 
dimenoional information aa defined in claim D, wherein 
the image piclc up oection comprioea : 

imaging meano for producing an optical image upon 
receipt of light reflected from the object; 

an image pick up clement which captureo the 
optical image and outputo a video oignal; and 

an image intcnoifier with gating operation which 
io diopooed between the imaging meano and the image 
pick up clement and which can control an image piclc up 
gain . 

[Claim 13] — The device for detecting three 
dimenoional information ao defined in claim 9, — wherein 
the oignal proccooing oection calculateo the diotance 
between reopectivc pointo of the object according to 
the method defined in any one of claimo 2 through 8. 
[DETAILED DECCRirTION OF TUB ILJVENTION] 
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[0001] 



Field of the Invention^ 



[Oil The present invention relates to a method and apparatus for 

detecting three-dimensional information pertaining to an object which can be 
applied to acquisition of a three-dimensional image, and more particularly, to a 
method and device which detects three-dimensional information pertaining to an 
object by two-dimensionally measuring the distance between points of the object 
at a speed at which the three-dimensional information can be followed in real time 
within a period relating to a frame of a video signal (hereinafter referred to simply 
as a "frame period"). 

[0002] 
tPrior Artf 

[021 The following methods have conventionally been employed as 

techniques for measuring the distance between an object and an image acquisition 
device or three-dimensional information through use of Ught. 
[0003] 

[031 I (1) As shown in FIG. 12, a pulse laser beam or a laser beam whose 

amplitude is modulated by a sinusoidal wave is radiated onto an object, and the 
distance between the object and the laser is measured on the basis of a period of 
time during which reflected light returns to the laser or a modulated phase of the 
reflected light. 
[OOOd] 



6 



[041 (2) As shown in FIG. 13, under the method (1), the distance 

between the respective points of an object is two-dimensionally measured by two- 
dimensionally scanning the laser beam over the object. 
[0005] 

[051 (3) As shown in FIG. 14, illumination Hght is modulated by a 

sinusoidal signal, and a light amplification gain of an image intensifier disposed 
in front of an image pick-up element is modulated through use of the sinusoidal 
signal. An optical image formed by collecting light reflected from the object 
through use of a lens includes a modulated phase corresponding to the distance 
between the object and the lens. Of an optical image input to the image 
intensifier, only a portion of the image whose phase matches a change in the light 
amplification gain is emphasized. As a result, the points of the object 
equidistantly spaced away from the lens can be two-dimensionally captured in the 
form of contour lines. The principle behind the third method is described in detail 
in Japanese Patent Apphcation Laid-Open No. Hei-6-294868 entitled "Imaging 
Laser Radar Device." 
[0006] 

^Problem to be Solved by the Invention^- 

[061 According to the method described in connection with (1), the 

distance between a single point of the object and the laser is measured, and hence 
three-dimensional information pertaining to the object cannot be produced. In 
order to acquire three-dimensional information by measuring two-dimensional 
distribution of the distance among the respective points of the object, the light 
beam must be moved so as to two-dimensionally scan the object as mentioned in 
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the method (2). Alternatively, according to method (3), since only portions of the 
object equidistantly spaced away from the lens are extracted, the modulated phase 
of illumination light must be changed to only a required extent in order to acquire 
three-dimensional information pertaining to the entirety of the object. Methods 
(2) and (3) require two-dimensional raster-scanning of an illumination Ught beam 
and a change in the modulated phase of the illumination light. Therefore, under 
these methods, acquiring three-dimensional information pertaining to the object at 
a speed equal to the frame period of a video signal is difficult. Therefore, the 
methods are not suitable for acquiring a three-dimensional image. 
[0007] 

The object of the present invention is to provide a method and 



device which solve the problem of the conventional technique, are suitable for 
acquiring a three-dimensional image, and enable detection of three-dimensional 
information pertaining to an object within a period of time corresponding to the 
frame of a video signal. 
[0000] 

■ — [Mcano for Solving tho rroblcm] 

SUMMARY 



_A three-dimensional information detecting method of the present 



invention comprises steps of: forming an image of an object illuminated by 
illumination of the modulated light having given intensity as an optical image, 
and detecting the distance between individual points of the object on the basis of 
an image obtained by acquisition of the optical image with a given image pick-up 
gain. Under this method, either the given intensity or the image pick-up gain is 
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changed with time, and the distance between respective points of the object can be 
detected at a speed at which the three-dimensional information can be followed 
real time within a period of time corresponding to the frame of a video signal. By 
utilization of the intensity or image pick-up gain which is changed with time, the 
two-dimensional distribution of intensity of light including information pertaining 
to the distance between the respective points of the object is acquired. 
Accordingly, the distance between respective points of the object can be 
determined on the basis of the intensity level information, whereby three- 
dimensional information pertaining to the object can be detected. 
[0009] 

[091 The image of the object can be acquired a plurality of times within 

the period of time corresponding to one frame of the video signal. In such a case, 
a signal-to-noise ratio (S/N) is improved by means of the storage effect of the 
image pick-up element, and the image pick-up intensity is enhanced. 
[0010] 

[101 A device for detecting three-dimensional information of the 

present invention comprises a projection section capable of projecting 
illumination light having given intensity on an object; an image pick-up section 
capable of acquiring an image of the object with a given image pick-up gain; and 
a signal processing section which calculates the distance between respective 
points of the object on the basis of intensity level information included in a video 
signal output from the image pick-up section. Either the given intensity or the 
image pick-up gain is changed with time, and the distance between respective 
points of the object can be detected at a speed at which the three-dimensional 
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information can be followed real time within a period of time corresponding to 
the frame of a video signal. By utilization of the intensity or image pick-up gain 
which is changed with time, the two-dimensional distribution of intensity of the 
image of the object that is acquired by the image pick-up section includes 
information pertaining to the distance between the respective points of the object. 
Accordingly, the signal processing section can calculate the distance between 
respective points of the object on the basis of the intensity level information. The 
device can acquire an image of the object within a sufficiently short period of 
time. So long as the signal processing section can compute the distance between 
respective points of the object at sufficient speed, the distance between respective 
points of the object can be detected at a speed at which the three-dimensional 
information can be followed within a period of time corresponding to the frame of 
a video signal 

PW^^ BRIEF DESCRIPTION OF THE DRAWINGS 

[Embodimcnto of the Invention] 

FIG. 1 is a schematic diagram showing the configuration of a three- 
dimensional information detecting device according to a first embodiment of the 
present invention; 

FIG. 2 is an illustration for describing a method of detecting three- 
dimensional information by utilization of illumination light which linearly 
increases and has given intensity and a pulse-like image pick-up gain in 
combination, wherein FIG. 2A shows a time-varying waveform determined by the 
intensity I of illumination light and an image pick-up gain "g/' and FIG. 2B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
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the intensity I g ^of light reflected from an object spaced away from a projection 
section by only distance "d"; 

FIG. 3 is an illustration for describing a method of detecting three- 
dimensional information by utilization of illumination light which linearly 
decreases and has given intensity and a pulse-like image pick-up gain in 
combination, wherein FIG. 3 A shows a time- varying waveform determined by the 
intensity I of illumination Ught and an image pick-up gain "g/' and FIG. 3B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
the intensity I^of light reflected from an object spaced away from a projection 
section by only distance "d"; 

FIG. 4 is an illustration for describing a method of detecting three- 
dimensional information by utilization of illumination light which linearly 
increases and decreases and has given intensity and a pulse-like image pick-up 
gain in combination, wherein FIG. 4A shows a time-varying waveform 
determined by the intensity I of illumination hght and an image pick-up gain "g/' 
and FIG. 4B shows a time-varying waveform determined by the image pick-up 
gain "g" and the intensity I^of light reflected from an object spaced away from a 
projection section by only distance "d"; 

FIG. 5 is an illustration for describing a method of detecting three- 
dimensional information by utilization of a given image pick-up gain which 
linearly increases and illumination light having pulse-like intensity in 
combination, wherein FIG. 5 A shows a time-varying waveform determined by the 
intensity I of illumination light and an image pick-up gain "g," and FIG. 5B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
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the intensity I n of light reflected from an object spaced away from a projection 
section by only distance "d"; 

[16] FIG. 6 is an illustration for describing a method of detecting three- 

dimensional information by utilization of a given image pick-up gain which 
linearly decreases and illumination Ught having a pulse-like intensity in 
combination, wherein FIG. 6A shows a time-varying waveform determined by the 
intensity I of illumination light and an image pick-up gain "g." and FIG. 6B 
shows a time-varying waveform determined by the image pick-up gain "g"' and 
the intensity I^of light reflected from an object spaced away from a projection 
section by only distance "d"; 

[17] FIG. 7 is an illustration for describing a method of detecting three- 

dimensional information by utilization of a given image pick-up gain which 
linearly increases and decreases and illumination light having pulse-like intensity 
in combination, wherein FIG. 7A shows a time-varying waveform determined by 
the intensity I of illumination light and an image pick-up gain "g." and FIG. 7B 
shows a time-varying waveform determined by the image pick-up gain "g" and 
the intensity Ig^of light reflected from an object spaced away from a projection 
section by only distance "d": 

[18] FIG. 8 is a schematic diagram showing the configuration of a projection 

section equipped with a light-emitting element whose light is directly modulated: 

[19] FIG. 9 is a schematic diagram showing the configuration of a projection 

section equipped with a light-emitting element whose light is indirectly 
modulated; 
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[20] 


FIG. 10 is an illustration showing the configuration of an image pick-up 


section employing an image intensifier CII) with gating operation; 




JTivJ. 1 i lo all liXUoirallUIl MlUWlll^ LllC L/UIlll^UiaLlUIl Ui a M^ilai piuv^coaill^ 


section: 


[22] 


FIG. 12 is an illustration showing a conventional method of measuring the 


distance between an object and a three-dimensional information detecting device 




on the basis of a lag time or modulated phase of a reflected laser beam; 


[23] 


FIG. 13 is an illustration showing a conventional method of activating a 


laser beam so as to effect two-dimensional scanning; and 




Tnir^ lA IC an illnctr5»tinn clinwina tVip ponficiirfitinn nf a pnnvpntinnal 


imaging laser radar apparatus. 




j^escnpiion oi ine iveicrencc iNumeidia 




1 ... signal generation section, 4 ... lens, 5 ... image intensifier with 




gating operation, 6 ... image pick-up element, 7 ... signal processing section, 10 




... projection section, 11 ... image pick-up section, 20 ... optical image transfer 




optical svstem, 21 ... gate, 22 ... image spHt circuit, 30 ... illumination optical 




system, 31 ... Ught-emitting element, 32 ... external modulator 




DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 




V dliUUo CimJUU-llllClllo Ul lllC piCoCllL lllVCllllUll will UC UCoUilUCU 




llClClllUCiUW Uy ICiCiCllUC IKJ lllC o.C'L/Ullipa.iljlli^ LUdWlll^o. X J.VJ. 1 lo d o^lldliam-/ 




Qiagrcun bnuwing d Lnrcc-uiniciioioiiai iiiiuiiiiaiiuii u.clcL'Iiii^ ucvil/C dL/L/Uiuiiig lu <x 




fir<it emhodiment of the nresent invention The device comorises a nroiection 




section 10 capable of illuminating an object with illumination hght S6 whose 
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amplitude is modulated; an image pick-up section 11 which receives light S7 
reflected from the object while changing an image pick-up gain with time and 
captures an optical image of the object; a signal processing section 7 for 
converting video signals S41 and S42 output from the image pick-up section 11 
into a three-dimensional information signal S5; and a signal generation section 1 
which produces an illumination light modulation signal SI, an image pick-up 
modulation signal S2, and a control signal S3. The specific configuration of these 
constituent elements will be described later. 
[0012] 

The principle behind the three-dimensional information detecting 



method of the present invention which uses the device shown in FIG. 1 will be 
described by reference to a specific example in which the intensity of the light 
source or an image pick-up gain is linearly changed with time. 
[0013] 

The three-dimensional information detecting method according to 



a first embodiment of the present invention will be described by reference to 
FIGS. 2 and 3. As shown in FIG. 2 A, the intensity I of illumination light is 
subjected to amplitude modulation, to thereby obtain I=St, where "t" represents 
time and "S" represents the rate of increase in intensity 2Io/T). As shown in 
FIG. 2B, the intensity Ir of light reflected from the object which is spaced by only 
distance "d" away from an exit of the projection section 10 is changed, as 
specified by S(t-2d/v), with a delay equal to a duration of time during which light 
travels between the projection section and the object (=2d/v, where "v" represents 
light speed). If reflected light having intensity 1+ at certain time t=to is acquired 
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for only a short period of time At («T) while an image pick-up gain "g" is taken as 
g=go (>0), the intensity 1+ of the resultant image is expressed by Equation (1). 



where a represents the area of the backward scattering cross-section of an object. 
Equation (1) includes information pertaining to the distance between the object 
and the three-dimensional information detecting device. Li order to eliminate the 
dependency of term (jl{A7td^y , the second image of the object is acquired while 
the intensity I of illumination Ught is uniformly maintained at I=Ir for a short 
period of time At from time T'. At this time, luminous intensity Irefgo is expressed 
by Equation (2). 



[OQld] 



a 



g,5(/o-2J/u)...(l) 



[0015] 



gJr -(2) 



refSo ~ 



The following equation is derived from Equations (1) and (2). 



refSo 



S{t^-2dlo) 



...(3) 



From Equation (3), we have 




Further, let Ir=Io; then 
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, 1 

a = —V 
2 



t.-\A -(5). 



From Equation (4) or (5), we have distance "d." 
[001(5] 

As mentioned above, the intensity of respective points of an optical 



image formed by collection of the light reflected from the object exposed to 
amplitude-modulated light includes information pertaining to the distance 
between the three-dimensional information detecting device and a corresponding 
point of the object. So long as the object is captured in the manner as mentioned 
above and Equation (4) or (5) is applied to the intensity of each of the pixels of 
the image, information pertaining to the distance between the respective points of 
the object are two-dimensionally obtained, whereby three-dimensional 
information pertaining to the object can be detected. 
[0017] 

As shown in FIGS. 3 A and 3B, even when the intensity I of the 



light source diminishes, as specified by I=Io-St, the distance "d" can be obtained 
in the same manner as mentioned previously. 
[0018] 

l-g.-JT^EAh-^ih-ldlv)] ...(6) 



^ ^ /.go J,-S\t,-ldlv) 
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Further, let Ir=Io; then 



...(9). 



As in the case of the previous example, the optical image formed by collection of 
light reflected from the object. So long as Equation (8) or (9) is appUed to each of 
the pixels of the image, information pertaining to the distance between the 
respective points of the object are two-dimensionally obtained, whereby three- 
dimensional information pertaining to the object can be obtained. 



method according to a second embodiment of the present invention will now be 
described. As shown in FIG. 4, the object is illuminated while the intensity of 
illumination light is modulated by employment of a triangular waveform. An 
optical image of reflected light is acquired twice; in other words, an optical image 
of reflected Ught whose intensity is 1+ is acquired at time t=to for only a short 
period of time At («T) with an image pick-up gain g=go(>0), and an optical image 
of reflected light whose intensity is 1. is acquired at time t=to+T/2 for only a short 
period of time At («T) with the image pick-up gain g=go(>0). From Equations (1) 
and (6), we have 



[OOIQ] 



1301 



-Referring to FIG. 4, a three-dimensional information detecting 



...(10) 



Uo Io-S(t,-2d/u) 
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if IJ R 



d = -v< t, 



2 1° S 



l + R 



...(11). 



Let the wavelength of illumination light modulated by a triangular waveform be 
defined as X=vT\ then fi-om S=Io/(T/2), we have 



^ 1 ^ 
a = —vtf. 

2 ' 4 



R 



1 + 



..(12). 



Further, if to is set to a given value, distance "d" can be expressed as a relative 
distance with reference to a reference point dref. Equation (13) represents a 
relative distance with reference to dref^O when to=T/4. 



[0020] 

...(13) 



a = — 



As in the case of the first embodiment, the optical image is formed by collection 
of Ught reflected fi*om the object. So long as any one of Equations (1 1), (12), and 
(13) is appUed to each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two-dimensionally 
obtained, whereby three-dimensional information pertaining to the object can be 
obtained. 



[0021] 



-According to a method which is complementary to the three- 



dimensional information detecting methods described in connection with the first 
and second embodiments, three-dimensional information pertaining to an object 
can be detected by capturing the image of the object with an image pick-up gain. 
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which Hnearly increases or decreases, through use of illumination light modulated 
in the form of a pulse for a short period of time. 
[0022] 

A three-dimensional information detecting method according to a 



third embodiment of the present invention will be described by reference to FIGS. 
5 and 6. As shown in FIG. 5A, illumination light is modulated such that an image 
pick-up gain "g" is linearly increased (i.e., g=Ut). Further, an object is exposed to 
light which illuminates like a pulse with intensity I=Io for only a short period of 
time At («T). Here, U designates the rate of increase in image pick-up sensitivity 
(=2go/T). The image pick-up gain g+ obtained when the light reflected from the 
object that is spaced only distance "d" from the three-dimensional information 
detecting device has retumed to the image pick-up device becomes 
g+=U(to+2d/v). The intensity Irog+ of an image resulting from the reflected light 
being captured is expressed by Equation (14). 
[0023] 

Irog.-TT^hU{t,^2dlv) ...(14) 

Further, in order to eliminate the dependency of term cr/(4m/^)% the object is 
illuminated for a short period of time At from time T' while the image pick-up 
gain "g" is uniformly maintained at g=gr. At this time, luminous intensity Irogr is 
expressed by Equation (15). 

[002d] 

{And ) 
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The following equation is derived from Equations (14) and (15). 



l,g^ _ U(t,+2d/o) 



...(16) 



From Equation (16), we have 



rf = i^-,„.I.J,.)...(17) 



Further, suppose gr=go; the following expression is derived from U=go/(T/2). 



-The distance "d" is derived from Equation (17) or (18). As in the case of the 
first and second embodiments, an optical image formed by collection of the light 
reflected from the object is captured. So long as Equation (17) or (18) is applied 
to the intensity of each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two-dimensionally 
obtained, whereby three-dimensional information pertaining to the object can be 
detected. 



decreases (g=go-Ut), the distance "d" can be obtained in the same manner as that 
employed previously. 




[0025] 



[331 



As shown in FIG. — ^6A, even when the image pick-up gain "g' 



[002S] 



<7 



h{go-U{h+2dlo)} ...(19) 
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Irog. ^go-U(t,^2d/o) 



...(20) 




U 



...(21) 



Further, let gr=go; then 




...(22) 



As mentioned previously, an optical image formed by collection of the light 
reflected from the object is captured. So long as Equation (21) or (22) is applied 
to the intensity of each of the pixels of the image, information pertaining to the 
distance between the respective points of the object are two-dimensionally 
obtained, whereby three-dimensional information pertaining to the object can be 
detected. 



fourth embodiment of the present invention will now be described by reference to 
FIGS. 7A and 7B. As shown in FIG. 7A, the image pick-up gain "g" is 
modulated through use of a triangular waveform, and an object is illuminated 
twice; in other words, an optical image is illuminated at time t=to through use of 
light which illuminates in a pulsating manner with intensity I=Io for only a period 
of time At («T), and an object is illuminated at time t=to+T/2 through use of light 
which illuminates in a pulsating manner with intensity I=Io for only a period of 
time At («T). From Equations (15) and (19), we have 
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■A three-dimensional information detecting method according to a 



21 



R = 



IroS. _ U{t,^2dlv) 



...(23) 



IroS- g,-U{t,+2dlv) 



...(24) 



Suppose the wavelength of the triangular waveform used for modulating the 
image pick-up sensitivity is defined as X=vT for convenience's sake, the 
following expression is derived from U=go/(T/2). 



As in the case of the second embodiment, if to is set to a given value, the distance 
"d" can be expressed as a relative distance with reference to the reference point 
dref. Equation (26) represents the relative distance with reference to dref=0 when 
to=T/4. 



As mentioned previously, an optical image formed by collection of the light 
reflected from the object is captured. So long as Equation (24), (25), or (26) is 
applied to each of the pixels of the image, information pertaining to the distance 
between the three-dimensional information detecting device and the respective 
points of the object are two-dimensionally obtained, whereby three-dimensional 
information pertaining to the object can be detected. 





[0Q2Q] 



-A method of increasing the image pick-up sensitivity in each of the 



previous embodiments will now be described. Li the previously embodiments, 
acquisition of an image having intensity I+go and an image having intensity Irefgo 
for the purpose of determining R+, acquisition of an image having intensity I_g. 
and an image having intensity Irefgo for the purpose of obtaining R_, or acquisition 
of an image having intensity I+go and an image having intensity Lgo for the 
purpose of determining R is performed a plurality of times within the period of 
time corresponding to one frame of an image signal. As a result, the signal-to- 
noise ratio (S/N) is improved by the storage effect of the image pick-up element 
used for acquiring an image, whereby the image pick-up sensitivity is improved. 
[0030] 

The configuration of the three-dimensional information detecting 



device shown in FIG. 1 will now be described in detail by reference to the 

drawings. 

[0031] 

FIG. 8 shows a projection section 10a which is another 



embodiment of the projection section 10 shown in FIG. 1. The projection section 
10a comprises a Ught-emitting element 31 whose hght can be directly modulated 
by an illumination modulation signal SI, and an illumination optical system 30 
which is disposed opposite the light exit surface of the light-emitting element 31, 
which shapes the light emitted from the light-emitting element 31, and which 
directs the light toward the object. For example, a semiconductor laser diode or a 
semiconductor light-emitting diode can be employed as the light-emitting element 
31. When such a light-emitting element is activated directly by the illumination 
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light modulation signal SI which is an electric signal, the element can emanate 
light whose intensity is changed at high speed. The thus-produced light is shaped 
by means of an illumination optical system 30 so as to illuminate an object, 
whereby illumination light S6 is produced. Accordingly, illumination light whose 
intensity is arbitrarily changed at high speed, such as increment light, decrement 
light, or pulse-like light, can be realized by means of the illumination light 
modulation signal SI. As mentioned above, the projection section having the 
configuration shown in FIG. 8 can be used as means for controlling the intensity 
of illumination light under the three-dimensional information detecting method of 
the present invention. 
[0032] 

f381 FIG. 9 shows a projection section 10b which is still another 

embodiment of the projection section 10 shown in FIG. 1. The projection section 
10b comprises a light-emitting element 33 which outputs given light; an external 
modulator 32 which is disposed opposite the light exit surface of the light- 
emitting element 33 and indirectly modulates the light emanated from the light- 
emitting element 33 in accordance with the illumination light modulation signal 
SI; and an illumination optical system 30 which shapes the light output from the 
extemal modulator 32 and is directed toward the object. An electro-optical effect 
light modulator or an electro-acoustic effect modulator can be used as the extemal 
modulator 32. Light whose intensity is modulated arbitrarily and at high speed 
can be produced by indirect modulation of the given light 34 output from the 
light-emitting element 34, through use of the extemal modulator 32. The thus- 
produced light is shaped by the illumination optical system 30 so as to illuminate 
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an object, whereby the illumination light S6 is produced. Like the projection 
section shown in FIG. 8, the projection section whose configuration is show in 
FIG. 9 can be used as means for controlling the intensity of illumination light 
under the three-dimensional information detecting method of the present 
invention. 
[0033] 

FIG. 10 shows an image pick-up section 11 which is another 



embodiment of the image pick-up section 1 1 shown in FIG. 1 . The image pick-up 
section 11 comprises a lens 4 which receives light reflected from an object and 
produces an optical image, an image pick-up element 6 which is disposed behind 
the lens 4 and picks up the optical image output from the lens 4, and an image 
split circuit 22 which outputs a video signal pertaining to a plurality of screens 
included in the electric signal output from the image pick-up element 6 while the 
video signal is divided into respective screens. Further, an image intensifier with 
gating operation 5 capable of controlling the image pick-up gain in accordance 
with the image pick-up gain modulation signal S2, which is an electric signal, is 
attached to the front surface of the image pick-up element 6 via an optical image 
transfer optical system 20. A fiber plate or lens can be used as the optical image 
transfer optical system 20. Light S7 reflected from an object is formed on a 
photo-electric screen of the image intensifier with gating operation 5 by means of 
the lens 4. An optical image amplified by the image intensifier with gating 
operation 5 is transferred by the optical image transfer optical system 20 and input 
to the photo-electric screen of the image pick-up element 6. 
[0031] 
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[401 The light amphfication gain of the image intensifier with gating 

operation 5 can be controlled at high speed by means of a voltage to be applied to 
a gate 21 of the image intensifier with gating operation 5. In the image pick-up 
section 11, the image pick-up gain can be changed at high speed by apphcation of 
the image pick-up gain modulation signal S2 to the gate 21. Accordingly, an 
image pick-up gain which is changed arbitrarily at high speed, such as a pulse-like 
image pick-up gain to be used for releasing a shutter for only a short period of 
time or an increment or decrement image pick-up gain, can be achieved. 
[0035] 

[411 In a case where the image pick-up section 1 1 is used in each of the 

previous embodiments, the image pick-up section 1 1 must acquire an image twice 
for calculating R+, or R and output a video signal pertaining to two screens per 
frame while the signal is split. To this end, in the image pick-up section 11, the 
image pick-up element 6 is activated twice as fast as it is activated in normal 
times, to thereby acquire a video signal pertaining to two images. The video 
signal is output from the image split circuit 22 while being divided into a video 
signal S41 and a video signal S42. Altematively, so long as there is employed an 
image pick-up element capable of acquiring an image for each pixel and at every 
image pick-up operation while effecting switching between the video signal S41 
and the video signal S42, the video signals 41 and 42 can be output while they are 
split. 

[003(5] 

[421 As mentioned above, the image pick-up section 11 whose 

configuration is shown in FIG. 10 can be used as means for controlling the image 
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pick-up gain under the three-dimensional information detecting method of the 
present invention. Further, the image pick-up section 11 can also be used as 
means for outputting two video signals resulting from twice-acquisition of an 
image while being split. 
[0037] 

[43] FIG. 11 shows a signal processing section 7 which is an 

embodiment of the signal processing section 7 shown in FIG. 1 . In this signal 
processing section 7, an intemal signal is driven at a rate — ^which is the same as 
the number of pixels of the video signal — and is subjected to pipe-line processing 
in individual circuits. After a synchronous signal has been eliminated from the 
video signals S41 in a synchronous signal separation circuit 41, the video signal 
S43 is stored in an image pick-up level storage circuit 1, and the video signal S44 
is stored in an image pick-up level storage circuit 2. A signal S45 output from the 
image pick-up level storage circuit 1 and a signal S46 output from the image pick- 
up level storage circuit 2 are input to a computation circuit 44, where R+, R., or R 
and the distance "d" are computed. A signal S47 output from the computation 
circuit 44 is a time-series signal resulting from two-dimensional scanning of the 
distance between the respective sections of the object. Time-axis fluctuations in 
the signal S47 are corrected by a storage circuit 45, and a synchronous signal is 
added to the thus-corrected signal b a synchronous signal addition circuit 46. The 
signal is output as a three-dimensional signal S5 whose video level corresponds to 
the value of information pertaining to the distance "d" between the respective 
points of the object. As mentioned above, the signal processing section 7 whose 
configuration is shown in FIG. 1 1 can be used as a means for computing three- 
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dimensional information pertaining to an object in real time under the three- 
dimensional information detecting method of the present invention. 
[003 8 ] 

[^Advantageous Result of the Invention^ 

As has been described in detail, the present invention enables two- 



dimensional determination of the distance between individual points of an object 
at a speed at which the three-dimensional information can be followed real time 
within a period of time corresponding to the frame of a video signal, as well as 
detection of three-dimensional information, by utilization of information 
pertaining to the intensity of an image of the object acquired under condition that 
either the intensity of illumination light or an image pick-up gain is changed with 
time. Consequently, the method and apparatus of the present invention can be 
suitably used for acquiring a three-dimensional motion picture of an object. 
[BRIEF DESCRIPTION OF TUB DRAWINGS] 
FiG-r 
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WHAT IS CLAIMED IS: 

1 stB a achcmatic diagram ahowing fefee 

conf icTuration . A method of a detecting three-dimensional 

information — detecting — device according — fee a f irat 

embodiment , comprising steps o f the preoent invention;! 

FIG , — 2 io an illuotration for deacribing a 

method of detecting three dimenoional information by 
utilization of illumination light which linearly 
increaaeo and hao given intenoity and a puloe like 
image pick up gain in combination, — wherein FIG. — 2A 
ohowo a time varying waveform determined by the 
intenoity I of illumination light and an image pick 
up gain ''g, " — and FIG. — 2B ohowo a time varying 
waveform determined by the image pic]c up gain ^^g" 
and the intenoity i R^ of light reflected from an 
object opaced away from a projection oection by only 
diotance — '"d" ; 

FIG . — 3 io an illuotration for deocribing a 

method of detecting three dimenoional information by 
utilization of illumination light which linearly 
decrcaoco and hao given intenoity and a puloe like 
image piclc up gain in combination, — wherein FIG. — ^ 
ohowo a time varying waveform determined by the 
intenoity I of illumination light and an image pick 
up gain ''g," and FIG. — 3B ohowo a time varying 
waveform determined by the image pick up gain ^^g'' 



and the intcnaity I ^- of light reflected from an 
object opaccd away from a projection oection by only 
diotance ''d'' ; 

FIG . — 4 io an illuotration for deacribing a 

method of detecting three dimenoional information by 
utilisation of illumination light which linearly 
increaaea and dccreaoeo and hao given intonoity and 
a puloe like image pick up gain in combination, 
wherein FIG. — 4 A ahowo a time varying waveform 
determined by the intenoity I of illumination light 
and an image pick up gain "g,'' and FIG. — 4B ohowo a 
time varying waveform determined by the image pick 
up gain ''g" — and the intenoity I^ ^ of light reflected 
from an object apaced away from a projection aection 
by only diotance "d'' ; 

FIG . — 5 ia an illuotration for deocribing a 

method of detecting three dimenoional information by 
utilization of a given image piclc up gain which 
linearly incrcaoco and illumination light having 
puloe like intenoity in combination, — wherein FIG. — SA 
ohowo a time varying waveform determined by the 
intenoity I of illumination light and an image pick 
up gain ''g," and FIG, — 5B ohowo a time varying 
waveform determined by the image pick up gain ''g'' 
and the intenoity I^^of light reflected from an 
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object apQccd away from a projection ocction by only 
diotancc — ''d" ; 

FIG . — 6 io an illuatration for deocribing a 

method of detecting three dimcnoional information by 
utilization of a given imago pick up gain which 
linearly decreaaca and illumination light having a 
puloe li]ce intenoity in combination, — wherein FIG. — GA 
ahowa a time varying waveform determined by the 
intenoity I of illumination light and an imago pick 
up gain "g," and FIG. — 6D ohowa a time varying 
waveform determined by the image pick up gain ''g" 
and the intenoity I^^of light reflected from an 
object opaced away from a projection oection by only 
diotancc "d" ; 

FIG , — 7 io an illuatration for deocribing a 

method of detecting three dimcnoional information by 
utilization of a given image pick up gain which 
linearly increaoeo and dccreaoco and illumination 
light having puloe lilce intenoity in combination, 
wherein FIG. — 7A ohowo a time varying waveform 
determined by the intenoity I of illumination light 
and an image pick up gain ''g,'' and FIG, — 7D ohowo a 
time varying waveform determined by the image pick 
up gain ^^g" and the intenoity I f^ of light reflected 
from an object opaced away from a projection ocction 
by only diotancc "d" ; 
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FIG . — 8 ia Q ochcmatiG diagram ohowing the 

configuration of a projection acction equipped with 
a light emitting element whooc light io directly 
modulated; 

FIG . — 9 io a ochematic diagram ohowing the 

configuration of a projection oection equipped with 
a light emitting element whooc light io indirectly 
modulated; 

FIG. — 10 io an illuotration ohowing the 

configuration of an image pick up oection employing 
an image intenoificr — — with gating operation; 

FIG ■ — 11 io an illuotration ohowing the 

configuration of a oignal proceooing oection; 

FIG ■ fomiing an image of an object illuminated by 

illumination light having given intensity as an optical image; and 

detecting a distance between individual points of the object on the 
basis of an image obtained by acquisition of the optical image with a given 
image pick-up gain, wherein either the given intensity or the image pick-up 
gain is changed with time, and the distance between respective points of the 
object can be detected at a speed at which three-dimensional information can 
be followed real time within a period of time corresponding to the frame of a 
video signal. 

2. The method of detecting three-dimensional information as 
defined in claim 1, wherein first and second optical images of the object 
illuminated by first and second illumination light, either of which includes 
time-varying intensity, are formed; first and second images are obtained by 



acquiring the first and second optical images with a single image pick-up gain 
over a given period of time; and the distance between respective points of the 
object can be detected on the basis of the first and second images at a speed at 
which the three-dimensional information can be followed real time within a 
period of time corresponding to the frame of a video signal. 

3. The method of detecting three-dimensional information as 
defined in claim 2, wherein the intensity of the first illumination light is 
increased or decreased with time, and the second illumination light has a given 
intensity. 

4. The method of detecting three-dimensional information as 
defined in claim 2, wherein the intensity of the first illumination light is 
increased with time, and the second illumination light is decreased with time. 

5. The method of detecting three-dimensional information as 
defined in claim L wherein there are formed first and second optical images of 
the object illuminated by first and second illumination light which illuminate 
with single intensity over a predetermined period of time: and the distance 
between respective points of the object is detected from the first and second 
images which are produced by acquisition of the first and second optical 
images with the first and second image pick-up gains, either of which is 
changed with time, at a speed at which the three-dimensional information can 
be followed real time within a period of time corresponding to the frame of a 
video signal. 

6. The method of detecting three-dimensional information as 
defined in claim 5, wherein the first image pick-up gain is increased or 
decreased with time, and the second image pick-up gain is uniform. 



7. The method of detecting three-dimensional information as 
defined in claim 5, wherein the first image pick-up gain is increased with time, 
and the second image pick-up gain is decreased with time. 

8. The method of detecting three-dimensional information as 
defined in any one of claims 1 through 7, wherein the image is acquired a 
plurality of times within a period of time corresponding to the frame of a video 
signal. 

9. A device for detecting three-dimensional information 
pertaining to an object comprising: 

a projection section capable of projecting illumination light having 
given intensity on the object; 

an image pick-up section capable of acquiring an image of the object 
with a given image pick-up gain: and 

a signal processing section which calculates the distance between 
respective points of the object on the basis of intensity level information 
included in a video signal output firom the image pick-up section, wherein 
either the given intensity or the image pick-up gain is changed with time, and 
the distance between respective points of the object can be detected at a speed 
at which the three-dimensional information can be followed real time within a 
period of time corresponding to the frame of a video signal. 

10. The device for detecting three-dimensional information as 
defined in claim 9, wherein the projection section is equipped with a light- 
emitting element whose light can be modulated in accordance with an electric 
signal 



11. The device for detecting three-dimensional information as 
defined in claim 9, wherein the projection section comprises a light-emitting 
element, and a modulator capable of modulating light emitted from the light- 
emitting element. 

12 — arS — an — illuotration — ahowing — a — conventional 
method — — meaouring — fefee — diotance — between — aH — object 
and Q three dimcnoional — information detecting device 
OH — the — baoio — e£ — a — 3rag — time — or modulated phaoe — — a 
reflected laoer beam; . The device for detecting three- 
dimensional information as defined in claim 9, wherein the image pick-up 
section comprises: 

FIG . — 13 io an illuotration ahowing a 

conventional method of activating a laoer beam oo ao 
to effect two dimcnaional acanning; — afid 

FIG , — 14 ia an illuotration ahowing the 

configuration of a conventional imaging laaer radar 
apparatuo . 

[Deocription of the Reference Numeralo] 

1 ... aignal generation aection; — 4 „. lenO; — S-^. 

image intcnaifior with gating operation, — S ... image 
piclc up clement, — 7 ... aignal proccaaing ocction, — 10 ,.. 
proj cction oection, — 11 „, image pick up aection, — 2 0 ... 
optical image — tranofer optical oyatem, — 21 ... gate, 
22 ... image oplit circuit, — 30 - illumination optical 
oyotem, — 31 ... light emitting element, — 32 ■„ external 
modulator 



[DOCUMENT NAME] imaging means for producing an optical 

image upon receipt of light reflected from the object; 

an image pick-up element which captures the optical image and 
outputs a video signal: and 

an image intensifier with gating operation which is disposed between 
the imaging means and the image pick-up element and which can control an 
image pick-up gain. 

13. The device for detecting three-dimensional information as 
defined in claim 9. wherein the signal processing section calculates the 
distance between respective points of the object according to the method 
defined in any one of claims 2 through 8. 



ABSTRACT OF THE DISCLOSURE 

[Abridgment] 

[Object] — It io an object of tho prcocnt 

invention to provide a met]iod and apparatuo wtiicli 
can be applied for acquiring a three dimenoional 
image of an object and detect tliree dimcnoional 
information pertaining to tine object real time 
within a period of time correoponding to tine frame 
of a video oignal. 

[Meano for Achieving the Object] — An image of an 

object illuminated by illumination light having given intensity is foraied as an 
optical image. The distance between respective points of the object is 
detennined on the basis of a video which is obtained by acquiring the optical 
image with a given image pick-up gain. Here, either the intensity of the 
illumination light or the image pick-up gain is changed with time. The 
distribution of intensity of the image acquired by utilization of such intensity 
or image pick-up gain reflects a time lag between the time at which the 
illumination light is emitted from a light source and the time at which the light 
reflected from individual points of the object reaches an image pick-up device. 
The distribution of intensity includes information pertaining to the distance 
between the light source and the respective points of the object. The 
preaont invention enables detection of three 
dimenaional information at a opeed at which the 
three dimenoional information can be followed real 
time within a period of time corrcaponding to the 
frame of the video oignal. 
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